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DETAILED ACTION 

1 . The following is a quotation of the second paragraph of 35 U.S.C. 1 12: 

The specification shall conclude with one or more claims particularly pointing out and distinctly claiming the 
subject matter which the applicant regards as his invention. 

2. Claim 30 is rejected under 35 U.S.C. 1 12, second paragraphias being indefinite for 
failing to particularly point out and distinctly claim the subject matter which applicant regards as 
the invention. 

Instant claim 30 applicant states "altimeter and/or bathymetric", and in the specification the use 
of both these devices in the same embodiment is not disclosed. Furthermore, the use of both an 
altimeter and bathymetric sensor is not logical as one is for measuring altitude (airplane/satellite 
applications) and the other is for measuring depth (submarine/boat/underwater applications). 
Thus for the purpose of moving forward with the prosecution of this application Examiner will 
treat the "and/or" as an "or" when examining the claim with regards to the prior art. 

Claim Rejections - 35 USC §102 

1 . . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

2. Claims 26-29, 31, 33, 35-38, 40, 42-44 are rejected under 35 U.S.C. 102(b) as being 
clearly anticipated by Kumar (US 2001/003871 8). 

Instant claim 26: An apparatus for presenting a highly spatially accurate visualization of a scene 
from which measurements can be taken, the apparatus comprising: 
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at least one camera for recording a plurality of frames of video images of the scene; [Figure 1, 
paragraphs 0029 and 0031] 

at least one sensor mounted in relation to the camera for recording sensor data on positional 
characteristics of the camera as the at least one camera is moved with respect to the scene; and 
[Camera is mounted on an airplane (figure 1) with an ESD module that is a sensor module that 
generates positional and attitude information (paragraphs 0033 and 00041).] 
image processing means including a first module for synchronizing the frames with the sensor 
data to form corrected frames, and a second module for constructing an accurate mosaic from the 
corrected frames. [ESD module records the data and matches it with the video data (see 
paragraphs 0033-0034 and 0041-0043).] 

Instant claim 27: The apparatus as claimed in claim 26, wherein the at least one camera is a 
video camera capturing two dimensional digital images. [The input images (video frames) 
referred to in paragraph 0031 are inherently two-dimensional] 

Instant claim 28: The apparatus as claimed in claim 26, wherein the at least one sensor 
comprises a sensor capable of making a positional measurement. [See paragraph 0033 wherein 
positional (GPS) measurements are taken by an ESD sensor module.] 

Instant claim 29: The apparatus as claimed in claim 28, wherein the at least one sensor 
comprises a digital compass. [See paragraph 0033 wherein position and attitude information are 
taken, which encompasses orientation and position of the platform.] 
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Instant claim 3 1 : The apparatus as claimed in claim 26, wherein the at least one camera and the 
at least one sensor are mounted on a moving platform. [Figure 1, wherein moving platform is an 
airplane.] 

Instant claim 33: The apparatus as claimed in claim 26, wherein the first module performs a 
perspective correction to the images using the sensor data. [See paragraphs 0033, 0043, and 
045-0046 wherein Kumar teaches the creation of the synthetic view (based on ESD sensor data), 
which is a corrected perspective of the taken images.} 

Instant claim 35: The apparatus as claimed in claim 26, wherein the apparatus further includes 
display means for providing a visual image of the mosaic. [See figure 1 wherein user views 
displayed mosaic, and paragraphs 0029-003 1 which discloses the display generation module.] 

Instant claim 36: The apparatus as claimed in claim 26, wherein the apparatus further comprises 
data storage means to allow the mosaic to be stored. [Kumar discloses mosaicing the current 
video images and displaying them, but does not explicitly disclose the storage of the mosaic 
images. However, further matching and correspondence of these images with reference images 
is performed and various other operations and measurements are performed on this data. It is 
inherent that in order to perform these operations the video mosaic data is stored in a known 
storage medium such as the described components in paragraph 0030.] 
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Instant claim 37: The apparatus as claimed in claim 26, wherein the apparatus includes a graphic 
user interface (GUI). [See figure 1 and paragraphs 0029-0031 wherein the user interfaces with 
the displayed images. ] 

Instant claim 38: Claim 38 describes the method performed by the apparatus of claim 26. As 
per rejection of claim 26 the system and method have been taught by Kumar. 

Instant claims 40 and 42: Claims 40 and 42 describes the method performed by the apparatus of 
claim 33 and 35, respectively. As per rejection of claims 33 and 35 the system and method have 
been taught by Kumar. 

Instant claim 43: The method as claimed in claim 38, wherein the method further includes the 
step of taking a measurement from the visual image. [See paragraph 0077 wherein the geo- 
spatial location of a user selected point is measured from the visual image.] 

Instant claim 44: The method as claimed in claim 38, wherein the method includes the step of 
storing the images so that they may be accessed by spatial position. [See paragraph 0005 
wherein included by reference is a method of forming a mosaic and accessing the images based 
on based on geo-coordinates (spatial position). ] 



Claim Rejections - 35 USC § 103 
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3. Claim 30 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kumar as applied 
to claims 26-30 above, and further in view of Benkelman (US 6694064). 

Instant claim 30: The apparatus as claimed in claim 28, wherein the at least one sensor 
comprises an altimeter and/or bathymetric sensor. [Kumar cites the use of sensor data in aligning 
the images, but does not specifically list the measurement or use of altitude data in mosaicing the 
image. However, Benkelman teaches an image mosaicing technique wherein aerial photographs 
are taken and measurement of platform (camera) orientation and altitude are taken and use for 
image correction and mosaicing. It would have been obvious to one of ordinary skill in the art 
to combine the two similar aerial imaging techniques taught by Kumar and Benkelman in order 
to further improve the accuracy of the method taught by Kumar by factoring the altitude 
measurement into the image correction and mosaicing process.] 

4. Claims 45 and 47-50 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kumar as applied to claims 26-30, 35-36, 38 and 43 above, and further in view of Linnett 
("Underwater Video Mosaicing For Seabed Mapping"). 

Instant claim 45 describes the method performed by the system of claim 26 (corresponding 
method claim is 38), and as per rejection of instant claims 26 and 38 the method has been 
disclosed except for the limitation wherein the method is performed in a fluid. Kumar teaches an 
airplane which does its measuring, image taking, and mosaicing above ground, but not 
underwater. However, Linnet teaches the underwater imaging and mosaicing of the seabed using 
an AUV (similar to an ROV but is mostly autonomous). It would have been obyious to one of 
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ordinary skill in the art to combine the mobile platform image system taught by Kumar with one 
(as taught by Linnet) that is operable in a "fluid" (underwater environment) to increase the 
accuracy of the underwater mobile image mosaicing platform. 

Instant claim 47-48 and 50: These limitations have been taught as per rejection of claims 45, 35- 
36, 38, and 43. 

Instant claim 49: The method as claimed in claim 45, wherein the platform is mounted on a 
remotely operated vehicle (ROV). [See rejection of claim 45 wherein Linnet teaches anAUV, 
which is an ROV that is at least semi-autonomous. ] 

5. Claims 32 and 39 are rejected under 35 U.S.C. 103(a) as being unpatentable over Kumar 
as applied to claims 26-30 and 38 above, and further in view of Hall ("Image Registration and 
Mosaicing Using a Self-Calibrating Camera"). 

Instant claim 32: The apparatus as claimed in claim 26, wherein the apparatus further includes a 
calibration system from which the at least one camera is calibrated. [Kumar teaches the system 
described in claim 38 as well as the purpose of the invention in paragraphs 0006-0009 which is 
to provide a more accurate imaging and mosaicing system, but does not teach the calibration or 
the inclusion of a calibration system for the system. However, Hall teaches a self calibrating 
camera specifically for image registration and mosaicing. In the 1 st paragraph of the 
introduction Hall provides the motivation for using a self calibrating camera, which is to 
improve the accuracy of image registration and mosaicing systems. Thus it would have been 
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obvious to one of ordinary skill in the art to combine the teachings of Kumar with Hall to 
increase the accuracy of the image mosaicing.] 

Instant claim 39: Claim 39 describes the method performed by the system of claims 38 and 32 
and as per rejection of claims 38 and 32 the system and its corresponding method have been 
taught. 

6. Claim 46 is rejected under 35 U.S.C. 103(a) as being unpatentable over Kumar in view of 
Linnett ("Underwater Video Mosaicing For Seabed Mapping") as applied to claim 45 above, and 
further in view of Hall. 

Instant claim 46: The method as claimed in claim 45, wherein the method includes the step of 
pre-calibrating the camera to compensate for distorting artifacts inherent within the camera. [See 
rejection of claims 45 wherein it would have been obvious to combine teachings of Kumar and 
Linnet, and claims 32 and 39 wherein it would have been obvious to combine the teachings of 
Kumar and Hall. Furthermore, give that both Kumar and Linnet teach mobile image mosaicing 
platforms with a need for accuracy then it would have been obvious to one of ordinary skill in 
the art to provide a self-calibrating camera, as is taught by Hall to either system to maintain or 
increase the accuracy of the mobile platform throughout the imaging process.] 

7. Claims 34 and 41 are rejected under 35 U.S.C. 103(a) as being unpatentable over Kumar 
as applied to claims 26-30 and 38 above, and further in view of Ham (US 2002/0101438). 
Instant claim 34: The apparatus as claimed in claim 26, wherein the second module 
accomplishes video mosaicing via a correlation technique based on frequency contents of the 
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images being compared. [Kumar teaches various methods of correlating (corresponding, 
matching, registering) the series of images with a known set of reference images, but does not 
accomplish the mosaicing using the frequency (phase) correlation technique. However, Ham 
teaches in paragraphs 0006, 0015, 0028, and figure 5 the mosaicing of images by phase 
correlation which is a frequency correlation technique. It would have been obvious to one of 
ordinary skill in the art that the substitution of a known image registration technique that can be 
used for image mosaicing, as is taught by Ham, for the registration technique taught by Kumar 
would provide a predictable result (a set of mosaiced images)] 

Instant claim 41 : Claim 41 describes the method performed by the system of claims 38 and 34 
and as per rejection of claims 38 and 34 the system and its corresponding method have been 
taught. 

Conclusion 

8. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

• Gracias ("Underwater Video Mosaics as Visual Navigation Maps") - teaches 
underwater image taking and mosaicing. 

• Mignotte ("Markov Random Field and Fuzzy Logic Modeling in Sonar Imagery: 
Application to the Classification of Underwater Floor") - teaches underwater 
imaging. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Nathan Bloom whose telephone number is 571-272-9321. The 
examiner can normally be reached on Monday through Friday from 8:30 am to 5:00 pm (EST). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Samir Ahmed, can be reached on 571-272-7413. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). 
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